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COMPUTATIONAL  EXPERIENCE  IN  SOLVING  LINEAR  PROGRAMS* 


by 


Ao  Hoffman,  M„  Mann os , Do  Sokolowsky  and  No  Wiegraann 
National  Bureau  of  Standards 


Introduction 

This  paper  is  a discussion  of  three  methods  which  have  been 
employed  to  solve  problems  in  linear  programming,  and  a compari- 
son of  results  which  have  been  yielded  by  their  use  on  the  Stand- 
ards Eastern  Automatic  Computer  (SEAC)  at  the  National  Bureau  of 
S tandards  0 

A linear  program  is  essentially  a scheme  to  run  an  organiza- 
tion or  effect  a plan  efficiently,  ioe0,  it  is  a technique  of 
management  which  serves  to  minimize  costs,  maximize  returns  or 
achieve  other  ends  of  a similar  nature,.  To  illustrate  the  kind  of 
"life  situation*8  to  which  linear  programming  is  applicable,  and 
the  technique  of  formulating  the  circumstances  mathematically, 
let  us  examine  a particular  problem,,  For  this  purpose,  we  choose 
a simplification  of  the  so-called  **caterer  problem**  of  W0  Jacobs  „ 

A caterer  knows  that  in  connection  with  the  meals  he  has 
arranged  to  serve  during  the  next  n days,  he  will  need  rj(>  0) 

fresh  napkins  on  the  j-th  day,  j = 1,2,0oo,n0  Laundering  takes 

♦This  work  was  supported  (in  part)  by  the  Office  of  Scientific 
Research,  USAF»  The  coding  and  operation  of  the  methods  was 
performed  by  Ro  Bryce,  I„  Diehm,  L„  Gainen,  B„  Handy,  Jr„, 

Bo  Heindish^  No  Levine,  Fo  Meek,  So  Pollack,  Ro  Shepherd  and 
Oo  Steiner0 


p days;  that  is,  a soiled  napkin 

of  the  j-th  day  is  returned  in  time  to  be  used  again,  on  the 
(j+p)th  day,  Having  no  usable  napkins  on  hand  or  in  the  laundry, 
the  caterer  will  meet  his  early  needs  by  purchasing  napkins  at  ja 
cents  each.  Laundering  costs  b cents  per  napkin,  How  does  he 
arrange  matters  to  meet  his  needs  and  minimize  his  outlays  for 
the  n days? 

Before  expressing  the  caterer8®  problem  algebraically,  two 
conventions  of  notation  will  be  stated » The  subscript  j through- 
out has  the  range  1,2,0oo,n;  every  equation  involving  j is  to 
hold  for  the  entire  range  ©f  valuego  Quantities  with  subscripts 
outside  this  range  are  always  zero. 

Let  Xj  represent  the  napkins  purchased  for  use  on  the  j-th 
day;  the  remaining  requirements,  if  any,  are  supplied  by  laundered 
naj 

any  other  soiled  napkins  on  hand,  let  y.  be  the  number  sent  t< 

J 

ie  stock  of  soiled  napkins  left,  Consequeni 


the  Tj  napkins  which  have  been  used  on  that  day  plus 


the  laundry  and  s . 

J 


y-  + s 


Fj 


The  stock  of  fresh  napkins  on  hand  on  the  j-th  day  must  be 
t least  as  great  as  the  need.  Thus 

j j 


(2) 


j 

E 

i=1 


X . + 

1 


1=1 


v o > 
* i~p  rr 


r . 

i 


i=1 


The  total  cost  to  be  minimized,  subject  to  the  constraints 

(1)  and  (2)  on  the  nonnegative  variable  x.,y.5s.,  is 

J J J 


n 


j=1 


'a  x.  + b y . 
J <J 


This  is  a mathematical  formulation  of  the  problem  the  caterer 
wishes  to  solve. 
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If  desired,  the  equation  (1)  can  be  changed  into  inequali- 
ties. For  example,  (1)  is  equivalent  to  the  pair  of  inequalities 

yj  + sj  - sj-i  £ Ti 
-yi  ~ si + sj-i  ^-rr 


If  we  make  this  change,  then  it  is  clear  that  the  problem  just 
described  is,  mathematically,  a special  case  of  the  followings 
Let  A = be  a given  m x n matrix;  b = (b^,...,bm)  an  111- 

dimensional  vector,  c = (c^,..*,c  ) an  n-dimensional  vector. 
For  all  vectors  x = (x^,*..,x  ) satisfying 

(3)  xi  = 0 

and 


(4) 


a1 1 X1  + a1  2 x2  + • ° B+  aln  xn  = b1 
a21  X1  + ...  + **  a2n  b2 

o 


‘ml 


X1  + 


+ a x > b 
ran  n=  m 


(briefly,  Ax  ^ b) . 

minimize  (c,x)  = c.x.+.o.+c  x„. 

1 1 n n 

The  foregoing  is  the  mathematical  statement  of  the  general 
linear  programming  problem.  In  geometric  language,  it  is  to 
find  a point  on  a convex  polyhedron  (the  region  satisfying  (3) 
and  (*+))  at  which  a given  linear  form  (c^ x^ + . . «+cnxn)  is  a minimum. 


The  Computation  Laboratory  of  the  National  Bureau  o f 
Standards,  with  the  sponsorship  and  close  cooperation  of  the 
Planning  and  Research  Division  of  the  Office  of  the  Air  Comp- 
troller, U.  S * Air  Force,  has  been  engaged  in  the  task  of  dis- 
covering ane  evaluating  methods  for  computational  attack  on 
this  problem,  and  this  paper  is  in  a sense  a progress  report  on 
a part  of  this  work  (see  also  Orden  [10]). 

The  three  techniques  that  have  received  most  attention  so 
far  are  (a)  the  MS implex”  method,  devised  by  George  Dantzig, 

(b)  the  Fictitious  Play  method  of  George  Brown  and  (c)  the 
Relaxation  Method  of  T«  So  Motzkin.  Each  will  be  described  in 
more  detail  in  the  next  section,  but  for  the  present  it  is  ap- 
propriate to  remark  that  the  simplex  method  is  a finite  algorithm 
and  the  other  two  are  infinite  processes®  Further,  the  other 
two  methods  are  designed  to  solve  not  the  linear  programming 
problem  per  se  but  two  related  problems?  fictitious  play  finds 
a solution  to  a matrix  game  - i,eM  a zero-sum  2-person  game  in 
normalized  form  - and  relaxation  finds  an  x satisfying  (*+)  - 
iee.,  solves  a system  of  linear  inequalities.  It  is  known, 
however  (see  Gale,  Kuhn  and  Tucker  [6],  Dantzig  [*+],  Orden  [9] 
that  the  three  problems  (i)  solving  a linear  program,  (ii)  solv- 
ing a matrix  game,  (iii)  solving  a system  of  linear  inequalities 
are  in  general  equivalent  in  that  each  of  (i),  (ii)  and  (iii) 
can  be  so  formulated  that  it  becomes  either  of  the  other  two. 

For  purposes  of  comparison,  the  following  experiment  was 


undertaken.  Several  symmetric  matrix  games  (i.e.,  games  whose 
matrices  were  skew-symmetric)  were  attacked  by  each  method  in 
turn  and  the  results  studied  with  respect  to  the  accuracy  achieved 
and  the  time  required  to  obtain  this  accuracy.  Many  conjectures 
about  the  relative  merits  of  the  three  methods  by  various  cri- 
teria could  only  be  verified  by  actual  trial.  Apart  from  the 
descriptions  of  the  methods,  the  paper  is  concerned  principally 
with  the  results  of  the  experiment,  but  some  other  aspects  of  the 
comparison,  revealed  more  strikingly  by  other  computations,  will 
also  be  mentioned. 

The  games  in  question  have  as  payoff  matrices  the  submatrices 
of  order  5>6, 7*8,9)10  obtained  from  the  following  10x10  array 
by  deleting  the  last  five  rows  and  columns,  the  last  four  rows 
and  columns,  etc. 
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-1 
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-4 
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-1 

3 

-2 

-6 

1 
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-1 

-1 
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-1 

1 

-1 

1 

-1 

-1 
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2 
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4 

1 

5 
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2.  Description  of  the  Methods 
(a)  The  Simplex  Method. 

The  simplex  method  solves  the  problem:  minimize 

clV"*+cnxn 

for  all  vectors  x = ) satisfying 
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where  A = (a.  .)  is  an  m x n matrix  and  b = (b^ ,.,.,bm). 

This  differs  slightly  from  the  formulation  of  the  general 
linear  programming  problem  in  which  Ax  ]>.  b,  but  the  inequalities 
can  be  made  into  equations  by  appending  dummy  nonnegative  var- 
iables. 

An  algebraic  description  of  the  process*  is  given  in  Dantzig 
[5]  and  Orden  [9]»  and  will  not  be  repeated  here.  While  it  is 
not  excessively  complicated  it  is  somewhat  lengthy,  and  we  merely 
remark  now  that  it  very  much  resembles  elimination  methods  for 
solving  equations.  Even  for  those  familiar  with  the  algebra,  how- 
ever, (as  well  as  for  novices),  the  following  geometric  interpre- 
tation is  illuminating.  First,  to  state  the  problem  in  geometric 
language;  if  A-.,..., A are  the  m-dimensional  column  vectors  of 
A,  let  A^ 1 , • . • ,A  1 be  the  (m+1 )-dimensional  vectors  obtained 
f rom  A^ , . . . ,An  by  appending  c1,...,cq  respectively  as  the  (m+1)th 
coordinate.  Let  C be  the  cone  in  (m+1 )-space  spanned  by  these 
vectors.  Let  B be  the  line  in  (m+1 )-space  consisting  of  all 
points  whose  first  m coordinates  are  b^,...,biQ.  The  object  of 
the  computation  is  to  find  the  lowest  point  of  B which  is  also 
in  C,  i.e.,  the  point  of  B whose  (m+1)th  coordinate  is  a minimum. 

The  computation  proceeds  in  the  following  way;  assume  that 

m of  the  vectors  A^  ' , . . . ,An  1 , say  A ’ , • • • »A./  are  given  which 

*1 

are  linearly  independent  and  have  the  property  that  the  m- 
dimensional  cone  D they  span  contains  a point  of  B.  (Such  a set 


^Interesting  variations  suggested  by  Charnes  [33  and  Wolfe  [12] 
have  not  yet  been  tested. 
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of  vectors  may  have  to  be  given  initially  by  an  artificial  device 

which  we  shall  not  describe  here).  Of  all  the  remaining  vectors 

A^’,  let  us  look  at  the  subset  of  those  which  are  on  the  side  of 

the  hyperplane  containing  D that  does  not  contain  the  positive 

(m+1)th  coordinate  axis.  These  vectors  are  all  "lower**  than  D. 

Each  of  these  vectors  can  be  joined  to  the  hyperplane  containing 

D by  a line  segment  parallel  to  the  (m+1)th  coordinate  axis.  Let 

A^8  be  the  vector  with  the  property  that  this  line  segment  has 

maximal  length  - i.e.,  A^8  is  the  "lowest"  of  the  low  vectors. 

Then  A. 8 and  a certain  set  of  m-1  of  the  vectors  A . 8 , . . . ,A  . 8 
1 V1  - vm- 

have  the  property  that  the  m-dimensional  cone  they  span  contains 

a point  of  B,  and  this  point  will  be  lower  than  the  intersection 

of  D with  B.  We  replace  the  discarded  vector  of  the  set 

A^  Ay  8 with  A. 8 and  proceed.  This  replacement  process  is 

i vm  1 

an  iteration  in  the  simplex  method)  and  clearly  the  computation 
must  stop  after  a finite  number  of  iterations  with  the  desired 
lowest  point  of  the  intersection  of  C and  B. 

The  symmetric  games  were  formulated  for  the  simplex  method  as 
follows § 

Let  A = (a.  .)  be  the  n x n game  matrix.  We  wish  to  find  an 
x = (x^,.o.,x  ) such  that 

Ax  <_  0 

Xi^O 
= 1 


This  is  equivalent  to 
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(a^  + 1 ) x.j  + (fi-j2  + 1)  x2+ 


n 


+ w 


n 


1 


x±  > 0 (i  = 1 

w,  >^0  (i  = 1 


n) 

n); 


maximize 


(thus  minimize  -Xg-***-*  ) which  is  suitable  lor  simplex  com- 
putation. We  omit  the  proof  of  the  equivalence  as  well  as  the 
justification  for  choosing  this  particular  way  of  formulating 
the  game  as  a simplex  computation,  since  both  depend  on  technical 
reasons  irrelevant  to  the  main  purpose  of  the  paper. 

(b)  Fictitious  Play  „ 


tional  scheme  that  will  solve  symmetric  games  can  be  adapted  to 
the  solution  of  linear  programming  problems.  The  fictitious  play 
method,  devised  by  G.  Brown  [2]  and  proved  valid  by  J.  Robinson 


the  computation  is  simpler  (particularly  from  the  standpoint  of 
storage)  if  the  game  is  symmetric.  And  since  our  primary  in- 
terest is  in  linear  programs  rather  than  games  per  se,  we  have 
confined  our  attention  to  the  symmetric  case. 

If  A = (a-  •)  is  skew-symmetric,  our  object  is  to  solve  the 

J 

system  of  linear  inequalities 


It  is  well  known  (see  Dantzig  [*+]),  that  a computa- 


[11], is  a procedure  for  solving  an  arbitrary  matrix  game,  but 
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(5) 


a11  X1  + a21  x2+000+an1  % = 0 


a1 2 X1  + a22  x2+0°0+an2  Xr  i 0 


X,  3 X o o 0^3  X ^ 0 

Ini  2n  2 nn  n = 


subject  to  the  conditions  x.  > 0 (i  = 1,2,...,n), 


n 


i=1 


x . = 1 


The  fictitious  play  method  consists  of  forming  two  sequences 
of  n-dimensional  vectors,  V(0),  V(1),  V(2),...,  and  T(0),  T(1), 
T(2),...,  with  V(0)  = T(0)  = 0<>  V(N)  (N=1,2,...)  is  obtained 
by  adding  the  r-th  row  of  A to  V(N-1),  where  the  r-th  coordinate 
of  V(N-1)  is  the  minimum  of  the  coordinates  of  V(N-1 ) and  of  small- 
est index  among  all  the  coordinates  equal  to  the  minimum.  The 
smallest  index  criterion  is  used  in  order  to  be  specific  but  is 
in  no  way  essential.*  T(N)  is  the  same  as  T(N-1)  except  for  the 
r-th  coordinate  which  is  larger  by  1 . In  effect,  the  j-th  com- 
ponent T.(N)  of  T(N)  represents  the  number  of  times  the  j-th  row 
of  the  matrix  A has  been  selected  by  the  above  criterion  in  form- 
ing V(N).  Hence,  if  V.(N)  denotes  the  j-th  component  of  V(N), 

J* 

we  have 


V . (N)  = a,,  T,(N)  + a~.  T„(N)+ . . .+a„  . T.(N)  = 
J il  1 2j  2 nj  j 


N 


i=1 


a.  . T. (N) 
ij  i 


To  (N) 

Upon  setting  x^(N)  = — 


this  is  equivalent  to 


V . (N)  N 

(6)  ^ — a^ j x,j  (N)  + 82  j X2 ( N)+ o o .+ a j x^(N)  — ^ ■■  a^jX^(N) 


*This  procedure  is  followed  in  the  illustrative  example  on  page 
12  but  not  in  the  SEAC  code. 
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Since  T^  (N)  >.  0,  and  T,  (N)  + T?(N)+ . . .+Tn(N)  = N,  it  follows  that 

x.(N)  >0  and  x1  (N)  + x0(N)+  • • .+x„ (N)  = 1.  If  the  first  player 

follows  the  strategy  (x^ (N) , XgCN) , » o • »xn(N) ) his  expectation 

is  the  least  of  the  expressions  (6),  and  except  in  the  trivial 

case  that  the  first  row  of  A consists  of  nonnegative  elements , 

V.  (N) 

min  — will  be  negative , which , by  (6),  implies  that  the  in- 
J 

equalities  (5)  will  not  be  satisfied..  It  is  however,  the  main 
result  of  J,  Robinson's  paper  that 

rain  V.(N) 

lira  i ^ = 0 

N~^oo  N 

This  implies  (See  Hoffman  [7],  McKinsey  [8]),  that  the  vector 
x(N)  = (x.,(N),...,x  (N))  approaches  the  convex  set  of  all  solu- 
tions to  (5)  as  N increases  indefinitely,  though  it  does  not  imply 
(indeed,  it  is  not  true)  that  x(N)  converges*  Of  course,  if  the 
first  player  is  willing  to  follow  a strategy  such  that  his  ex- 
pected loss  is  no  greater  than  € , he  may  follow  the  strategy 

V.  (N) 

x(N) , where  min  - ^ >_  - 6 . 

j N - 

These  considerations  suggest  that  the  speed  of  convergence 
of  the  fictitious  play  method  should  be  determined  by  deciding 
how  "long”  it  takes  for  the  process  to  arrive  at  a vector  x(N) 
such  that  the  corresponding  expected  loss  is  no  greater  than  ^ 
for  a given  decreasing  sequence  of  positive  numbers  & . 

At  least  two  criteria  are  relevant  in  measuring  ?boW^long” 
it  takes  to  attain  an  & $ the  size  of  N and  the  time  consumed  on 
the  computer.  Both  are  given  in  the  table  of  results,  A third 
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criterion  is  suggested  by  the  manner  in  which  the  procedure  was 
codedo  It  is  apparent  from  Je  Robinson’s  proof  and  readily  veri- 
fiable by  experience  that  as  the  computation  proceeds  the  same 
row  vector  of  A will  be  added  to  V(N)  for  a large  stretch  of 
successive  values  of  No  Hence,  the  code  picks  out,  not  only  the 
row  to  be  added  to  V(N),  say  A , but  decides  how  many  times  Ar 
is  to  be  added  to  V(N)  before  some  other  row  is  added;  i.e, 
it  determines  a number  S(N)  such  that 

V (N+1  ) - V(N)  o=V(N+S  (N)  ) - V ( N+S  ( N ) - 1 ) = Ar 

but 


V(N+S (N)  + 1)  - V(N  + S (N) A 


The  number  S(N)  is  the  least  positive  integer  not  less  than 


r?J  a XO 
rJ 


Vr(N)  - Vj(N) 

rj 


if  Mb  . is  not  an  integer  (i0eo  S(N)  = [ M .])  and  S(N)  = 

J J 

[M_  .]  + 1 if  H.  . is  an  integer0  In  the  latter  case  ties 
r?  J r 9 J 

resulting  between  the  j-th  and  k-th  components  with  k > j are 
resolved  in  favor  of  the  k-th  componento 

Then  V(N+S(N))  = V(N)  + S(N)*Ar,  T(N+S(N))  = T(N)  + S(N)*6r, 
(where  6p  is  the  r-th  unit  vector,,) 

The  foregoing  computation  and  subsequent  changes  in  V(N)  and 
T(N)  are  essentially  computational  ’’steps”  in  the  SEAC  code 
and  therefore  the  number  of  such  steps  it  takes  to  attain  a 
given  £ is  a third  proper  criterion  by  which  to  measure  the 
convergence  rate  of  the  process. 

Before  listing  the  experimental  data  and  the  conclusions, 
let  us  illustrate j except  for  a slight  modification, the  prece- 
ding descriptions  of  the  process  by  an  example» 
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The  modification  consists  of  letting  S(N)-[M  .]  if  either  M . 

r9  J r 9 J 

is  not  an  integer  or  is  an  integer  with  j<r  and  S (N)=[M„  .]+1 

r»  3 


if  M .is  an  integer  with  j>r„ 
r,  j 

Let  G be  the  payoff  matrix 


0 0 2 -1 
0 0-12 
-2100 
1-200 


which  is  the  same  as  the  illustrative  matrix  in  J,  Robinson's 
papero  The  first  component  of  V(0)  guides  the  choice  of  the  row 
of  G added  to  V(0),  Hence  the  first  row  of  G is  added  to  V(0)  in 
order  to  obtain  V(1)o  In  the  next  step  the  fourth  component  is 
taken  as  the  minimum  and  so  the  fourth  row  of  G is  added  to  V(1  ) 
yielding  V(2),  In  the  next  five  steps  the  second  component  is 
the  minimum  and  5 times  the  second  row  of  G is  added  to  V(2), 
giving  V(7)«  In  the  next  two  steps  one  observes  that  the  third 
component  is  the  minimum  and  so  adds  2 times  the  third  row  of  G 
to  V(7)  to  get  V(9)o  It  is  the  first,  fourth,  second  and  third 
components  in  that  order  which  give  rise  to  the  minimum  component 
Due  to  the  simplicity  of  the  payoff  matrix  which  has  but  one  negfi 
tive  element  in  each  row  the  minimum  component  keeps  passing 
through  the  same  cycle  as  above,  For  example,  in  the  next  cycle 
the  first  component  is  a minimum  13  successive  times,  the  fourth 
component  2 times,  the  second  component  28  times,  and  the  third 
component  2 times , That  is,  S (9)  = 13?  S (22)  = 2,  5(24)  = 28, 
and  S(52)  = 2,  Similarly,  in  the  next  cycle  one  may  verify 
that  S (54)  = 58,  5(112)  = 2,  5 ( 1 1 4)  = 1 1 8,  S (232)  = 2C  It  is 
then  observed  that  for  any  of  the  following  cycles  the  first 
component  appears  as  a minimum  4 times  as  many  plus  6 as  it  does 
in  the  previous  cycle.  The  second  component  follows  this  pattern 
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whereas,  the  third  and  fourth  components  appear  as  a minimum, 
twice  in  each  of  the  succeeding  cycles»  In  the  first  cycle  then, 
the  first  component  appears  once  as  the  minimum  component  and  in 
the  n-th  cycle  (n  2 2)  the  first  component  appears  as  the  minimum 
in  13c1*11”2  + 6(4n"3+1+n"lf+o  0 e+4+i  ) = 1 3 An“'2+2oI+n“2-2  = l5.4n“2 
- 2 successive  stepsQ  In  the  first  cycle  the  second  component 
appears  5 times  as  the  minimum  component  and  in  the  n-th  cycle 
(n  > 2)  the  second  eomponent  appears  as  a minimum  in 
28,4n“2+6(4n"3+4n"^+, , ,+4+1 ) = 28,4n“2+2,4n”2-2  - 30o4n“2-2 
successive  steps.  The  third  component  enters  twice  as  the  mini- 
mum component  in  each  cycle;  whereas,  the  fourth  component  is  a 
minimum  one  time  in  the  first  cycle  and  2 times  in  each  cycle 
thereafter.  It  is  quite  clear  that  x^(N)  and  xj+(N)-^-0 
as  N— >oo.  If  one  computes  the  x(N)  for  each  N at  the  end  of 
each  cycle,  it  is  seen  that  x1  = 1/3  and  x2  = 2/3®  However,  by 
computing  x(N)  for  various  other  sequence  of  N's  it  may  be  ob- 
served that  x^ (N)  and  x2(N)  come  close  to  any  value  between  1/3 
and  2/3  provided  their  sum  is  1,  While  the  sequencesof  x^  (N) 
and  x2(N)  oscillate  as  N — *-oo  , one  may  pick  out  a subsequence 
of  the  N8s  such  that  the  corresponding  subsequence  of  the  x(N)!s 
converges  to  any  given  optimal  strategy, 

(c)  Relaxation  Method  • 

There  have  been  several  proposed  versions  of  the 
relaxation  method  and  what  we  call  the  relaxation  method  here 
might  more  properly  be  termed  the  "furthest  hyperplane”  method. 


The  object  of  the  computation  is  to  1 a point  which  satis- 
fies a finite  system  of  linear  inequalities 

n 

"'S'  a 4 • x • + b»  0 (i  — 1,2,ooo,ra) 

Aj  J -*■  — 

j=1 

The  set  of  points  which  satisfy  one  of  these  m inequalities  is 
called  a half-space  and  the  set  of  points  which  satisfy  the 
corresponding  equation  is  called  the  bounding  hyperplane  of  the 
half-space,,  A point  satisfies  the  entire  system  of  inequalities 
(i„e0  is  a solution)  if  and  only  if  it  lies  at  the  intersection 
of  the  m half-spaces,, 

The  procedure  is  indue tive,  producing  an  infinite  sequence 
0 12 

of  points  x ,x  ,x  ,o„o)which  converge  to  a solution  (see  Agmoe 
[l])j  provided  one  exists  „ x^  is  arbitrary,.  Assuming  we  Slave 

x1  , (k  = 0,1 ,2,000  x is  obtained  as  follows^ 

k k+1  k 

If  x is  a solution,  x = x 

k 

If  x is  not  a solution,  there  are  one  or  more  of  the  given 
half  spaces  which  do  not  contain  it„  Among  the  bounding  hyper- 
planes of  these  half-spaces,  let  o»C  be  one  at  a maximum  distance 

k k 

from  x and  let  p be  the  point  of  <*■  nearest  x1  „ Then 

xk+1  = xi<L  + t(p-xk)  where  0 < t < 2„ 

Three  values  of  t were  tried,  namely  t = 3/4-  (undershoot), 

i 

t = 1 (normal -here  x w = p),  and  t = 3/2  (overshoot) „ 

We  now  describe  the  process  algebraically  along  with  a 
summary  of  the  machine  procedure,.  The  code  does  not  use  the 
algebraic  formulation  which  would  yield  the  fastest  computational 
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procedure  (the  reader  can  easily  concoct  such  a procedure  using 

T 

the  matrix  AA  ),  for  the  naive  method  followed  required  less  in- 
ternal storage,, 


n 


Let  the  set  of  inequalities  be  normalized,  a. . =1, 

n 

(i  = 1,2,...,m).  Let  y^  = '>__J  a^j  x^  + b^,  choose  an  initial 

J=1- 

set  of  values  for  x?  x^  C0),...,x^nd  obtain  a corresponding 
set  of  ys  y.j  ^ . ,yn^ 


If  all  the  y^  are  nonnegative,  the 


(0) 


x.v  yform  a solution®  If  not  choose  the  largest  (in  absolute 
value.)  of  the  negative  y^^ , call  this  y^^  , and  form  new 


t*a 


(0) 


kj 


where  0 < t < 2, 


values  x.  according  to  x.^y  = x 
J J J 

Substitute  the  x.  ^ into  the  system  and  obtain  a new  system  of 


ys  y 


(1) 


i . 

U) 


90009 


X 


Continue  in  this  way  to  form  a sequence  x^ 
(i) 


(i) 


n 


for  i = 1 ,2 


000  o 


The  machine  procedure  has 


been  as  follows?  Given  the  m x n matrix  A - (a..),  the  problem 

J 


is  scaled  so  that  J max  a°  .j  < 1,  Each  inequality  is  multiplied 
_L|. 

by  10  so  that  the  b^  are  properly  scaled.  This  scaling  is  to 
be  kept  in  mind  in  interpreting  the  final  results.  Next  con- 
version is  made  from  the  decimal  to  the  binary  system  and  the 
system  is  normalized.  The  matrix  A and  the  b^‘s  are  stored  in 


the  machine, 
in  all  the  problem  work 


The  initial  choice  is  x^^  = 0 for  i - 1,2,...,n 


In  order  to  measure  convergence,  it  is  reasonable  to  com- 
fit) 

pare  the  size  of  the  negative  y^  relative  to  k itself.  In 
this  case  the  following  procedure  was  adopted?  an  €.  > 0 was 
chosen  and  a solution  was  considered  as  obtained  when  the  minimum 
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y^  > - 6 . The  <=  was  made  progressively  smaller  and,  on  the  basis 

of  previous  experience  was  taken  successively  as  2”  , 2 , 2 J , 

—11  —12  —22 

2 ? 2 ,...,2  ® The  time  required  to  satisfy  a given  6 was 

also  noted  in  each  instance. 

The  game  problem  was  transformed  into  a pure  inequality 

problem  in  the  following  manners  If  the  m x n game  matrix  is 

A = (a.  .),  the  expected  payoff  for  player  one9if  he  engages  in  a 
^ n 

mixed  strategy  x^  ^x^  > • » <>  ,xr,  is  given  by  M = min  a^j  x^9  where 

^x.  - 1,  x.  > Oo  Since  the  game  is  symmetric,  the  value  is 

zero  so  that  the  problem  reduces  to  solving 

m 

-Ax  > 0,  x >.  0 and  x.  = 1 , 

* i=1  1 

or  to  solving  the  (2m+2)x  m system  of  inequalities 

m \ m 

-Ax  >.  0 , x > 0,  ^ x^  - 1 , - x^  >_  -1  . 


3»  Numerical  Results 

(a)  Simplex  Method  - 

Table  I gives  the  answers  obtained,  the  number 
of  iterations  required  and  the  time  consumed  on  the  machine  by 
the  computation. 
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£*2 

6x6 

22k 1 

8x8 

2*1 

10x10 

X1 

0,00000 

0,00000 

0,00000 

0,00000 

0,12341 

0,03690 

x2 

0.59999 

0,00000 

0,00000 

0,00000 

0,00000 

0,00000 

x3 

0,19999 

0,20000 

0,19999 

0,04761 

0,00000 

0,08487 

x4 

0,19999 

0,20000 

0,20000 

0,26190 

0,25949 

0,22509 

x5 

0,00000 

0,00000 

0,00000 

0,00000 

0,06012 

0,10332 

x6 

0,60000 

0.59999 

0,57142 

0,02531 

0.12915 

x7 

0,00000 

0,09523 

0,03481 

0,00000 

x8 

0,02380 

0,06645 

0,00000 

x9 

0.43037 

0.39483 

x10 

0.02582 

No,  of 
item-  6 
tions 

5 

6 

7 

11 

A, 

Time 

(mins)  10 

8 

si 

9 

12 

15 

Note  that  the  number  of  iterations  is  about  n for  each  of 
these  n x 2n  linear  programming  problems.  This  is  in  accord  with 
our  general  experience  using  the  simplex  method  on  m x n problems 
that  a solution  takes  approximately  m iterations  unless  the 
artificial  device  mentioned  in  the  description  of  the  simplex 
method  given  in  2(a)  is  needed.  In  that  case  it  takes  about  2n 
iterations  to  reach  a solution.  These  estimates  are  completely 
heuristic,  but  they  are  based  on  over  fifty  simplex  computations 
of  various  sizes  and  are  probably  the  right  order  of  magnitude. 
The  success  that  the  simplex  method  has  enjoyed  is  based  largely 
on  the  fact  that  the  number  of  iterations  required  has  not  been 
larger. 
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(b)  The  Fictitious  Play  Methodo 

For  each  of  the  problems  many  answers  were  printed  as 
different  6 *s  were  attained,. 

Let  us  look  in  detail  at  the  results  of  the  6x6  game,  which 
illustrate  the  typical  properties  of  the  convergence  rates „ In 
table  II  are  given  the  approximate  solutions  x^(N)  corresponding 
to  the  various  values  of  £ „ The  step  in  going  from  V(N)  to 
V(N+S(N))  is  called  an  S“Step0  The  time  is  counted  from  the 
beginning  of  the  computation  excluding  the  time  taken  to  print 


out  the  answers  0 

6 = 2"2 

TABLE  II 

6 = 2~6 

6 ~ 2 10 

X*|  “ OoOl  69491  525 

xi 

= 0o0002732987 

X1  = 

0o0000013102 

0 

11 

OJ 

X 

x2 

= 0 

x2  = 

0 

X3  = 0o1016949152 

x3 

= Ool 866630226 

x3  = 

Ool 9903201 37 

x^  = Ool 864406779 

x4 

= Oo19978l36lO 

X4  = 

Ool 99998951 8 

x^  = 0 

x5 

= 0 

x5  = 

0 

x6  = Oo6949l5l542 

x6 

= 0.6132823175 

x6  = 

Oc 6009677241 

TIME  = Os  02 
S=steps  = 7 
N = 59 


TIME  = Os  12 
S-steps  = 52 
N = 3659 


TIME  = 2 s 01 

S-steps  = 742 
N = 763,234 


e = 2 


-11 


6=2' 


-12 


x1  = 0 0 0000003290 


= 0 


x^  = Ool 995141064 
= 0o1 999997367 


x 0 0000000824 
%2  = 0 

x ^ = 0o1997565760 


= 0 


x6  = 0o6004858277 

TIME  = 3050“ — 
S-steps  = 1480 
N = 3,039,349 


x^  = Ool 999999340 
x^  = 0 

x6  = Oo 6002434074 

fmT~=  6s  40  — 
S-steps  = 2956 
N = 12,130,279 
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Observe  that  for  £ sufficiently  small  the  number  of  S-steps 
required  to  "attain  the  £ " doubled  as  6 was  halved,  while  N 
quadrupled,,  This  phenomenan  held  for  all  the  games  solved  as 
part  of  the  experiment  and  for  others  not  part  of  the  experiment 
that  were  solved  by  the  Brown  method „ 

No  arithmetic  relationship  between  the  computing  time  (re- 
quired to  attain  a given  £ ) and  the  size  of  the  matrix  could 
be  determinedo 

(c)  The  Relaxation  Method, 

For  the  same  reasons  as  given  above  for  the  fictitious 
play  method,  we  present  below  (table  III)  the  results  of  the 
6x6  game  obtained  using  the  three  methods  of  relaxation,, 

(N  - number  of  iterations „ ) 
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TABLE  III 

—2 

€ =2  Undershoot  Normal  Overshoot 


X1  = 

Oo 125000 

0.015152  - 

=0e034309 

x2  = 

0 el  25000 

0o015152 

0.217439 

x3  = 

0 el  25000 

0 0 242424 

0.225306 

xk  = 

0.1 25000 

Oe 090909 

0.262019 

x5  = 

0.1 25000 

0o090909 

0.136145 

x6  = 

0 . 1 25000 

0 0 1 66667 

0.558348 

N 

2 

3 

5 

T 

0 §02 

08  03 

Tro 

=2“6 

Undershoot  Normal 

Overshoot 

xi  = 

-o.oi4o57 

Oo 000000  ■ 

=0.014191 

x2  = 

0.054008 

0.043413  . 

=0.004277 

x3  = 

0 o 21  71  43 

0.210530 

0.203763 

x4  = 

0 . 1 74677 

0. 177211 

0.203559 

x5  = 

0.010341 

-Oo 002738 

0.029268 

x6  = 

o. 545075 

0.546727 

0.585016 

N 

50 

33. 

12 

T 

0 § 56 

0§37 

0§13 

£ =2“ 

Undershoot  Normal 

Overshoot 

X1  = 

-0. 000697 

-Oe 000 9 23 

-0.000269 

x2  = 

0.003456 

0o002975 

-0.000320 

x3  = 

Oe 201 573 

0 0201360 

0.198920 

xk  = 

Oe 198840 

0.198293 

0.200325 

x5  = 

~0e 000877 

Oo 000000 

-0.000 288 

x6  = 

0.596372 

0.596994- 

0.599880 

N 

' T9B 

121 

37 

T 

3s42 

28  15  ' 

0s4i 
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€ = 2 Undershoot  Normal Overshoot 


X1  = 

-0.000372 

-0,000251 

-0, 000412 

x2  = 

O0OOI661 

0,001701 

-0,000462 

x3  = 

0 0200672 

0,200691 

0,199648 

x4  = 

0.199325 

0,199442 

0,200473 

x5  = 

”0  <>000408 

-0,000238 

-0,0001 40 

x6  = 

0»598l02 

0,598654 

0,600318 

N = 

236 

144 

39 

T = 

o§o4 

2s4l 

o?44 

£ = 

2~^  Undershoot 

No rmal 

Overshoot 

X1  = 

-0,000179 

-0,000216 

-0,000219 

x2  = 

0 ,000920 

0,000866 

-0,000194 

x3  = 

0,200323 

0,200202 

0,199861 

x4  = 

0,199665 

0.199755 

0,200260 

x5  = 

-0,000067 

-0,000172 

0,000176 

x6  = 

0,598970 

0.59935^ 

0,600318 

N = 

271 

168 

T = 

5 §03 

3T0B 

0§48 

6 = 

2”^  Undershoot 

No rraal 

Overshoot 

X1  = 

-0,000099 

-0,000093 

0,000110 

x2  = 

0,000436 

0,000399 

-0,000034 

x3  = 

0,200179 

0,200086 

0.199827 

x4 = 

0,199822 

0,199877 

0.200029 

x5  = 

-0,000104 

-0,000070 

-0.000055 

x6  = 

0.599505 

0,599696 

0.600185 

N = 

310 

193 

“W 

T = 

5§47 

3T36 

Os  54 

e = 

—1 4 

2 Undershoot 

No  rmal 

Overshoot 

xi  = 

-0,000023 

0,000000 

-0.000041 

x2  = 

0,000226 

0,000177 

0.000036 

x3  = 

0,200085 

0, 200040 

0.199914 

x4  = 

0,199904 

0,199916 

0.200052 

x5  = 

-0,000033 

-0, 000041 

-0.000035 

*6“ 

0,599760 

0.599772 

0.600149 

N = 

212 

55 

T = 

6s31 

3;  57 

C\J 

0 

00 
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e = 2' “1  ^ 

Undershoot 

Normal 

Overshoot 

xi  = 

“0  o 0000 26 

-Oo 0000 17 

-0o 000027 

x2  = 

0 oOOOl 1 6 

OoOOOIIO 

0o000017 

x3  = 

0 0 20004-7 

Oo 200055 

Ool 99932 

x4  = 

0,199953 

0.199957 

Oo 200003 

x5  = 

^0o 000028 

-Oo 0000 17 

0o000021 

x6  = 

Oo 599867 

0.599912 

Oo 600099 

N = 

383 

233 

6§ 

T = 

7 §09 

4s  21 

1814” 

6 = 2"1  6 

Undershoot 

N©  rnaal 

Overshoot 

X1  ”” 

=0o 000004 

-Oo 00001 5 

-Oo 0000 12 

%2  ~ 

Oo 0000 56 

0o000058 

Oo 000003 

x3  = 

Oo 200025 

Oo 200011 

0.199957 

x4  = 

Ool 99974 

Ool 99981 

Oo 200028 

*5  - 

-Q0 00001 4 

-Oo 00000? 

-0o000015 

x6  = 

0,5999*+6 

0.599953 

Oo 600060 

N = 

427  ’ 

256 

T " 

7 §58  ■ 

T74? 

1 §27 

6-  = 2-17 

Undershoot 

W© rmal 

Overshoot 

X1  = 

=Oo 000007 

-Oo 00000 2 

-0o000003 

x2  = 

Oo 000030 

0o000025 

-Oo 00000 8 

x3  s 

Oo 20001 3 

Oo 20000 5 

Ool 99984 

x4  = 

Ool 99988 

0.199989 

Oo 200010 

x5  = 

-Oo 000007 

-Oo 000006 

-Oo 000003 

x6  = 

0.599965 

0.599980 

Oo 600023 

N = 

*+57 
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Observe  that  overshoot  converged  faster  than  normal ? which 
in  turn  converged  faster  than  undershoot.  This  held  consis- 
tently for  all  the  games. 

Further ? for  Q sufficiently  small?  there  is  an  approx- 
imately uniform  increase  in  the  number  of  iterations  required 
to  ’'attain  a given  G n as  is  halved.  For  the  6x6  game?  for 
example?  from  6 = to  6=  3 the  additional  iterations 

required  to  go  from  6=  2”x  to  6=  were  approximately 

38  (for  undershoot),  2h  (for  normal)?  12  (for  overshoot). 

The  experiment  did  not  reveal  any  arithmetic  relationship 
between  the  size  of  the  matrix  and  the  computing  time. 

Conclusions 

Any  relative  evaluation  of  proposed  computation  schemes 
requires  specification  of  the  size  of  the  problem  considered? 
the  accuracy  demanded  and  the  amount  of  computation  time  rea- 
sonable to  invest  in  obtaining  this  accuracy.  Let  us  assume 
(in  accordance  with  the  requirements  of  most  of  the  practical 
problems  that  have  so  far  arisen  in  our  work)  that  four  or 
five  decimal  digits  are  required  in  the  answer?  and  that  the 
size  of  the  matrix  A<  is  say?  7^7  or  greater „ 

Then  the  simplex  method  is  outstanding  among  the  three. 

In  the  large  size  games  considered  in  the  experiment?  the 
simplex  method  achieved  answers  to  this  precision  in  a third 
or  a fourth  of  the  time  required  by  the  most  favorable  of  the 
others.  This  occurred  despite  the  fact  that  simplex  was 
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to  use  magnetic  tapes  for  storage  of  most  of  the  numbers  arising 
in  the  computation,  whereas  the  other  methods  stored  all  the 
numbers  within  the  high  speed  memory,,  It  is  estimated  that 
about  4/5  of  the  machine  time  required  for  simplex  on  these 
games  was  spent  in  bringing  the  needed  numbers  from  the  tape 
to  the  high  speed  memory  and  taking  the  numbers  from  the 
memory  to  the  tape.  (Improvements  in  tape  performance  sub- 
sequent to  these  computations  have  reduced  this  ratio  to  about 
^)„  The  other  methods  would  be  completely  impractical  if  tape 
had  to  be  used,  and  that  is  why  only  the  simplex  method  has 
solved  moderately  large  problems  (where  the  matrix  A is  about 
50x70)o  Even  assuming  a very  large  memory  so  that,  for  in- 
stance, a large  problem  could  be  coded  for  relaxation  in  the 
most  efficient  way,  then  the  fact  that  simplex  could  be  done 
internally  would  favor  it  even  more.  It  is  true,  however, 
that  because  simplex  is  more  complicated  algebraically,  it  is 
possible  by  clever  coding  to  fit  some  problems  into  the  high 
speed  memory  when  using  fictitious  play  or  relaxation  that 
could  not  be  so  accommodated  if  simplex  were  employed.  One 
such  large  problem  arose  in  our  works  the  computation  matrix 
was  48x71  for  the  simplex  method,  but  formulated  as  a symmetric 
game  and  using  ingenious  coding  devices,  it  could  be  done 
within  the  high  speed  memory  by  fictitious  play.  Neverthe- 
less, simplex  was  completed  in  half  the  time  that  fictitious 
play  required  to  obtain  the  same  accuracy. 
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Is  there  then  an  area  of  usefulness  for  the  infinite  methods? 
The  answer  is  yes,  for  problems  satisfying  the  following  condi- 
tions;  They  are  small  enough  to  be  done  entirely  within  the 
memory,  and  the  precision  demanded  is  very  slight  ©r  very  great,, 
Two  objections  to  the  simplex  method  ares  (i)  in  general, 
there  is  no  reason  to  believe  that  an  answer  from  an  early 
iteration  has  any  meaning  at  all,  so  there  is  no  provision 
for  doing  less  work  if  one  is  content  with  small  accuracy? 
and  (ii)  when  the  answers  are  finally  obtained,  there  is  no 
way  to  improve  them  to  obtain  greater  precision,,  (Wolfe's 
proposed  variation  [12]  of  the  .simplex  method  will  help  (ii)  , 
but  it  is  questionable  that  it  would  involve  less  work  than 
the  procedure  suggested  below) , 

If  the  purposes  of  the  computation  require  only  one  or 
two  decimals  in  the  answer,  then  one  is  perhaps  better  off 
using  the  infinite  methods „ This  is  verified  in  the  6x6  prob- 
lem,  which,  indeed,  favors  fictitious  play  over  relaxation 
for  this  purpose  (which  favorable  position  held  in  general) . 

If  the  purposes  of  the  computation  demand  greater  precision 
than  the  simplex  answers  yield,  then  it  is  reasonable  to  use 
the  simplex  answers  as  a starting  point  for  one  of  the  other 
methods.  And  here,  the  more  favorable  convergence  rate  for 
relaxation  (see  the  comments  in  3(b)  and  3(c)  over  fic- 
titious play  favors  the  use  of  the  former. 
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